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(54) An apparatus for localizing a sound image and a method for localizing the same 



(57) It is an object of the present invention to provide 
an apparatus for localizing a sound image capable of 
achieving so called "surround-effect" sufficiently with a 
simple structure while maintaining a sufficient width of 
a frontal sound field. Both surround left and surround 
right signals SL, SR are supplied to a sideward localizer 
1 2 for localizing the sound image reproduced by the sig- 



nals to positions of sideward of a listener. Also, front left 
and front right signals FL, FR are supplied to the side- 
ward localizer 12. In this way, the sound image repro- 
duced by the signals is localized at positions between 
speakers arranged in front side and sidewards of the 
listener, so that a sufficient width of frontal sound field 
can be maintained eventually. 
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Description 

Cross-Reference to Related Application 

5 [0001] The entire disclosure of Japanese Patent application No. Hei 9-335026 filed on November 18, 1997 including 
specification, claims, drawings, and summary is incorporated herein by reference in its entirety. 

BACKGROUND OF INVENTION 

to 1. Field of the Invention 

[0002] This invention relates an apparatus and a method for localizing a sound image, more specifically the simpli- 
fication of its structure and the processes. 

is 2. Description of the Prior Art 

[0003] An apparatus for localizing a sound image disclosed in Japanese Laid-open publication No. Hei 8-265899 
(265899/1 996) is shown in Fig. 9. The apparatus is used to make a listener 2 to feel that sound image reproduced by 
speakers XL and XR (hereinafter referred to as virtual speakers) is virtually localized at rear sides to the listener 2. By 
20 utilizing the apparatus, the listener 2 is able to feel like that he/she is surrounded by the sound reproduced with the 
speakers 4L and 4R as well as surrounded by the sound reproduced with the virtual speakers XL and XR even when 
only the speakers 4L and 4R are actually arranged. 

[0004] In the apparatus shown in Fig. 9, a total of four filters 6a, 6b, 6c and 6d are used to realize the sound image 
localization. Transfer functions H11, H12, H13 and H14 of respective filters are shown as following equations: 

25 

H11=(h RR h LL -h RL h LlR )/(h LL h RR -h LR h RL ) 
H12=(h LL h LlR -h LR h LL )/(h LL h RR -h LR h RL ) 
H21=(h RR h R , L -h RL h RlR )/(h LL h RR -h LR h RL ) 
H22=(h[_[_h R i R -h|_ R h R i|_)/(h|_|_h RR -h|_ R h R |_) 

30 

[0005] Wherein h RR is a transfer function from the speaker 4R to the right ear 2R of the listener 2, h RL is a transfer 
function from the speaker 4R to the left ear 2L of the listener 2, h LL is a transfer function from the speaker 4L to the 
left ear 2L of the listener 2, and hLR is a transfer function from the speaker 4L to the right ear 2R of the listener 2. 
[0006] Incidentally, equations h LL =h RR , h LR =h RL , h LL =h R i R , h L . R =h RL are satisfied in the equations stated above 
35 when the speakers 4R, 4L and the speakers XR, XL are arranged symmetric with respect to a central axis 8 through 
the listener 2. As a result, equations H11=H22, and H12=H21 can be derived, so that the apparatus can be realized 
by utilizing a total of two filers as shown in Fig. 10. Here, transfer functions H SUM , H D , F can be defined by the following 
equations: 

40 H SUM =(h al+ h bl )/(h a+ h b ) 
H D iF=(ha-hb')/(h a -h b ) 

wherein equations h a =h LL =h RR , h b =h LF ph RL , 

h a .=h LL =h RR and h b .=h L . R =h R . L are satisfied. 
45 [0007] Thus, the sound images can be localized at positions of the speakers arranged virtually with a simple structure 
when the actual speakers are symmetrically arranged. 

[0008] Although, a sound effect so called "surround-effect" can be achieved by using a total of two speakers in the 
conventional technology, not much attention is paid to widen a width of frontal sound field (hereinafter referred to as 
frontal width) defined between the speakers arranged in a front side. Therefore, it is not possible to enjoy the "surround- 
so effect" at sufficient level because of insufficient frontal width in an electric appliance such as a television set having a 
limited width for installing speakers therein. 

[0009] Further, a technology to localize virtual speakers to outward of the front speakers is disclosed in Japanese 
Laid-open publication No. SHO 52-116202 (116202/1977). Although, the frontal width can be widen by applying the 
technology to both signals for left and right channels, additional circuits respectively carrying out localization of both 
55 the channels are required for widening the frontal width in addition to a circuit to perform processings of surround 
channel signals. 

[0010] Still further, a technology achieving the "surround-effect" by using processings for localizing a sound image 
with respect to a surround channel signal is also disclosed in both Japanese Laid-open publications No. Hei 7-95697 
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(95697/1 995) and No. Hei 7-21 2898 (21 2898/1 995). However, the technologies disclosed therein do not allow to widen 
the frontal width. 

SUMMARY OF THE INVENTION 

5 

[0011] It is an object of the present invention to overcome the above mentioned drawbacks associated with prior 
arts, and to provide an apparatus for localizing a sound image capable of achieving sufficient "surround-effect" with a 
simple structure while maintaining a sufficient frontal width. 

[0012] In accordance with characteristics of the present invention, there is provided an apparatus and a method for 
io localizing a sound image, in which localization processings for localizing the sound image at sideward of a listener is 
further carried out to both a left and a right front signal so as to localize the sound image at positions between each of 
a left and a right speakers actually arranged and the sound image virtually localized at sideward of the listener. In this 
way the sound image reproduced by the left front and the right front signal can be shifted at positions sideward of the 
speakers actually arranged in front. Thereby, the frontal width can be widen even when the width defined between the 
is speakers is narrow. Moreover, localization of the sound image reproduced by the left and right front signal is carried 
out by the side localization processing for the surround signals. It is therefore, simplification of its structure and process- 
ings can be achieved. 

[0013] Also, in accordance with characteristics of the present invention, there is provided an apparatus for localizing 
a sound image, in which positions of the sound image reproduced by the left front and the right front signals are shifted 

20 by varying a ratio between the left front and the right front signals supplied to the left speaker and the right speaker 
and to the side localization means. In this way a sense of the frontal width can be varied by adjusting the ratio. 
[0014] Further, in accordance with characteristics of the present invention, there is provided an apparatus for local- 
izing a sound image, in which the surround signal includes a surround left signal and a surround right signal. In this 
way the "surround-effect" with higher realistic presence can be realized. 

25 [0015] In accordance with characteristics of the present invention, there is provided an apparatus for localizing a 
sound image, in which a center signal is added to each of the left front signal and the right front signal, and both the 
left front and the right front signal adding the center signal are supplied to the left speaker and the right speaker. In 
this way, the "surround-effect" with realistic presence can be achieved without providing additional speakers. 
[0016] Also, in accordance with characteristics of the present invention, there is provided an apparatus and a method 

30 for localizing a sound image, in which steps of generating a differential signal between the left front signal and the right 
front signal, obtaining a side signal responsive to a transfer function Hs in accordance with the differential signal, 
obtaining a center monophonic signal by adding the left front signal and the right front signal, supplying a signal to one 
of the left speaker and the right speaker, the signal being generated by adding the center monophonic signal and the 
side signal, and supplying a signal to one of the left speaker and the right speaker, the signal being generated by 

35 subtracting the side signal from the center monophonic signal are carried out, wherein the transfer function is defined 
as an equation of H s =(h ss -h SL )/(h a -h b ), and wherein h^. is equal to a transfer function from a speaker virtually localized 
at the right side to the right ear of the listener and a transfer function from a speaker virtually localized at the left side 
to the left ear of the listner, and wherein h SL is equal to a transfer function from a speaker virtually localized at the left 
side to the right ear of the listener and a transfer function from a speaker virtually localized at the right side to the left 

40 ear of the listener, and wherein h a is equal to a transfer function from the right speaker to the right ear of the listener 
and a transfer function from the left speaker to the left ear of the listener, and wherein hb is equal to a transfer function 
from the left speaker to the right ear of the listener and a transfer function from the right speaker to the left ear of the 
listener. 

[0017] In this way, a sound field created with a monophonic-side method can be obtained using just two speakers. 

45 in addition, this can be achieved by using just one filter. 

[0018] Further, in accordance with characteristics of the present invention, there is provided an apparatus for local- 
izing a sound image, in which the output signal of the add result output means being calculated by adding the center 
monophonic signal, the output of the filtering means and the front right signal is provided to the left speaker, the output 
of the subtracting result output means being calculated by subtracting the output of the filtering means from the center 

so monophonic signal and add the front left signal to the resulting signal is provided the right speaker. In this way, a wide 
frontal width can be secured regardless of the width defined between the speakers without making its structure complex. 
[0019] In accordance with characteristics of the present invention, there is provided an apparatus for localizing a 
sound image, in which a ratio between the center monophonic signal, and one of the front right signal supplied to the 
add result output means and the front left signal supplied to the subtract result output means is varied. In this way, the 

55 frontal width can be shifted with an apparatus having a simple structure. 

[0020] Also, in accordance with characteristics of the present invention, there is provided an apparatus and a method 
for localizing a sound image, in which steps of obtaining an add signal and a differential signal of a left front signal and 
a right front signal by carrying out coefficient processings to both the left front and the right front signals, and obtaining 
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an add signal and a differential signal of a surround left signal and a surround right signal by carrying out coefficient 
processings to both the surround left and the surround right signal, and then supplying signals calculated by adding 
the signals thus obtained to the first filtering means and the second filtering means are carried out. Further, the add 
signal and the differential signal of both the first and second filtering means are defined as elements of the output 

5 signals. Both a signal respectively carried out coefficient processings to both the left front and the right front signal and 
a signal carried out coefficient processings to outputs of each delay means are defined as elements of the output 
signals. Further, outputs carried out coefficient processings to each outputs of the delay means are also defined as 
elements of the output signals. In this way, a desired sound reproduction method can be selected easily from various 
sound reproduction methods such as a monophonic-side reproduction method, or a 4-channel surround method (two 

10 sound image in front and two sound image in side) using two actual speakers. 

[0021] Further, in accordance with characteristics of the present invention, there is provided an apparatus and a 
method for localizing a sound image, in which low frequency signals are added together after carrying out coefficient 
processings, and the resulting signals are filtered through high-pass filters in order to generate signals for the left 
speaker and the right speaker while generating a signal for a sub-woofer speaker through a low-pass filter. 

15 [0022] In this way, low frequency signals can be reproduced with the sub-woofer speaker even when both the left 
and the right speakers have insufficient capability of reproducing low frequency signals. 

[0023] In accordance with characteristics of the present invention, there is provided an apparatus for localizing a 
sound image, which comprises a center signal input terminal capable of supplying a center signal, a twelfth adding 
means for adding a signal carried out a coefficient processing using an eighth coefficient to the signal supplied through 

20 the center signal input terminal and the signal supplied through the left front signal input terminal, and an adding means 
for adding the signal carried out the coefficient processing using the coefficient to the signal supplied through the center 
signal input terminal and a signal supplied input through the right front signal input terminal, and an output of the adding 
means is supplied to the first delay means as an input thereof, and an output of the adding means is supplied to the 
second delay means as an input thereof. 

25 [0024] In this way, the "surround-effect" with higher realistic presence can be realized without providing additional 
speakers. 

[0025] While the novel features of the invention are set forth in a general fashion, both as to organization and content, 
the invention will be better understood and appreciated, along with other objects and features thereof, from the following 
detailed description taken in conjunction with the drawings. 

30 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0026] Fig. 1 is a block diagram illustrating an embodiment of an apparatus for localizing a sound image in accordance 
with the present invention. 

35 [0027] Fig. 2 is a view illustrating positions of the sound image reproduced by speakers both actually arranged and 
virtually localized with the apparatus shown in Fig. 1 . 

[0028] Fig. 3 is a hardware structure of the apparatus using a digital signal processor (hereinafter referred to as DSP) 
22. 

[0029] Fig. 4 is another view illustrating positions of the sound image reproduced by the speakers both actually 
40 arranged and virtually localized with processings shown in Fig. 5. 

[0030] Fig. 5 is a signal-flow diagram illustrating processings carried out by the DSP 22 shown in Fig. 3. 
[0031] Fig. 6 is another view illustrating position of the sound image reproduced by the speakers both actually ar- 
ranged and virtually localized with the processings shown in Fig. 7. 

[0032] Fig. 7 is a signal-flow diagram illustrating the processings carried out by the DSP 22 used in another embod- 
45 iment. 

[0033] Fig. 8 is a signal-flow diagram illustrating the processings carried out by the DSP 22 used in still another 
embodiment. 

[0034] Fig. 9 is a schematic view illustrating a sound image localization (so called "lattice type") apparatus according 
to the prior art. 

so [0035] Fig. 10 is a block diagram illustrating the sound image localization (so called "shuffler type") apparatus ac- 
cording to the prior art. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 

55 [0036] Fig. 1 is a block diagram illustrating an overall structure of an embodiment of an apparatus for localizing a 
sound image in accordance with the present invention. In the apparatus, signals l_o UT and Ft 0UT for speakers positioned 
both the left-hand and the right-hand in front of a listener are generated by inputting signals for left front FL, for right 
front FR, for surround left SL, and for surround right SR as input signals. Both the surround left signal SL and the 
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surround right signal SR are supplied to means 1 2 for localizing the sound image to the sideward of the listener (here- 
inafter referred to as sideward localization means) including two filters (so called shuffler type filters). The sound image 
reproduced by the surround signals SR and SL can be localized to sidewards of the listener 2 as virtual speakers XL 
and XR as shown in Fig. 2 as a result of supplying outputs of the sideward localization means 12 to both speakers 4L 
s and 4R. 

[0037] On the other hand, both the left front signal FL and the right front signal FR are supplied to the speakers 4L 
and 4R after completing delay processings with delay means 14L and 14R. The delay means 14L is a means for 
providing a delay time equivalent to a delay caused by both the sideward localization means 12 and an adding means 
1 6L. The other delay means 1 4R is a means for providing another delay time equivalent to a delay caused by both the 

10 sideward localization means 12 and an adding means 16R. By passing through both the delay means 14L and 14R, 
the delay arise between both the front left signal FL and the front right signal FR and both the surround left signal SL 
and the surround right signal SR can be compensated. As described above, the front left signal FL and the front right 
signal FR are given to the speaker 4L and the speaker 4R respectively, and a sound image is created at the positions 
of both the speakers 4L and 4R. 

15 [0038] Further, both the front left signal FL and the front right signal FR are supplied to the sideward localization 
means 12 in the embodiment. In this way, the sound image reproduced by the front left signal FL is localized not only 
at the position of the speaker 4L, but also at the position of the virtual speaker XL. Consequently, the sound image 
reproduced by the front left signal FL is localized at a position XXL between the speaker 4L and the virtual speaker 
XL. Similar to the front left signal FL, the sound image reproduced by the front right signal FR is localized at a position 

20 XXR. As a result, localized positions of the sound image reproduced by both the front left signal FL and the front right 
signal FR can be located outwardly from the positions of the speakers 4L and 4R. In other words, the frontal width can 
be widen even when the width defined between the speakers 4L and 4R is narrow. The apparatus is able to realize 
the above-mentioned localization with a simple structure because the sideward localization means 12 is also used as 
a filter for carrying out the localizing processings for widening the frontal width. 

25 [0039] Further, localized positions XXL (XXR) of the sound image reproduced by the front left signal FL (front right 
signal FR) can be shifted within an area defined between the speaker 4L (4R) and the virtual speaker XL (XR) by 
varying a ratio of the front left signal FL (the front right signal FR) supplied to the delay means 14L (14R), and that 
supplied to the sideward localization means 12. 

[0040] Fig. 3 is a hardware structure of the apparatus using a DSP 22. The apparatus is used to reproduce input 
30 signals that are center signal C, the front left signal FL, the front right signal FR, the surround left signal SL the surround 
right signal SR, and a low frequency signal LFE with both the speakers 4L, 4R as well as a sub-woofer speaker 4S. 
[0041] The input signals that are the center signal C, the front left signal FL, the front right signal FR, the surround 
left signal SL, the surround right signal SR, and the low frequency signal LFE are generated by decoding a digitized 
data converted from an analog signal with an analog-to-digital converter or a digital-bitstream encoded for surround, 
35 with a multi-channel surround decoder (not shown). The input signals are supplied to the DSP 22. The multi-channel 
surround decoder can either be incorporated into the DSP or separately provided therefrom. 
[0042] The signals LOUT and ROUT for the speakers positioned both the left-hand, the right-hand and a signal 
SUB OUT for the sub-woofer speaker are generated by performing processings such as addition, subtraction, filtering, 
delay and the like with the DSP 22 to the digital data thus input in accordance with program(s) stored in a memory 26. 
40 These signals thus generated are converted into analog signals with a digital-to-analog converter 24, and are supplied 
to the speakers 4L, 4R ; and 4S. Installation process of the program(s) into the memory 26 and other processings are 
carried out by a micro-processor 20. 

[0043] In this embodiment, it is presumed that the speakers 4L 4R, and the virtual speakers XL, XR are symmetrically 
arranged with respect to the central axis 8 through the listener 2 as shown in Fig. 4. Both a weak directivity and a long 
45 wave length of bass (sound having a low frequency) reproduced by the woofer speaker 4S allow the woofer to be 
arranged at any location. 

[0044] Fig. 5 is a signal flow diagram illustrating processings carried out by the DSP 22 in accordance with the 
program(s) stored in the memory 26. The center signal C is added to both the front left signal FL and the front right 
signal FR through add processings 44 and 46 in this embodiment. In this way, the sound image reproduced by the 

so center sinal can be localized at a position XC shown in Fig. 4. Lack of sound image in center (a phenomenon such 
that the listener feel like insufficient sound is reproduced in center of the sound field) caused by widening the frontal 
width can be avoided by utilizing the sound image thus localized at the position XC. The localization is useful especially 
to a movie that reproduces important information such as voice of actor(s) in the center part thereof. 
[0045] The low frequency signal LFE is added to both the left front signal FL and the right front signal FR after 

55 completion of a delay processing 30 for compensating a delay caused by both filters 12 SUM , 12 D!F (see add process- 
ings 1 8L, 1 8R). Thereafter, both the front left signal FL and the front right signal FR are added with each other through 
an add processing 54, and only the bass part of the added signal is extracted with a low-pass filter 60. The signal 
SUB OUT for the woofer 4S is generated by adding (see an add processing 62) the output of the low pass filter 60 to 
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the low frequency signal LFE being delayed in the delay processing 30. 

[0046] In this embodiment, both the signals L OUT and R OUT for the speakers are generated by carrying out high pass- 
filter processings 56, 58 in order to eliminate the bass part. 

[0047] In this way, a sound field with realistic presence is created with the woofer 4S even when the speakers 4L, 

s 4R reproduce the bass part insufficiently. 

[0048] Another embodiment of the apparatus realizing localization of virtual speakers XM, XL, and XR required for 
stereophonic reproduction using a monophonic-side reproduction method (so called M-S method) will be described. 
In the apparatus, both the signals L 0UT and Rqut ' or tne speakers 4L, 4R are generated from both the left front signal 
FL and the right front signal FR in order to localize the sound image at the positions of the virtual speakers XM, XL, 

to and XR shown in Fig. 6. It is also presumed that the speakers 4L, 4R, and the virtual speakers XL, XR are symmetrically 
arranged with respect to the central axis 8 through the listener 2. 

[0049] The hardware structure of the apparatus using the DSP 22 is similar to that of shown in Fig. 3, but the signals 
such as the center signal C, the surround left signal SL the surround right signal SR, and the low frequency signal 
LFE may be supplied to the apparatus as necessary. Fig. 7 is a signal-flow diagram illustrating the processings carried 

is out by the DSP 22 according to the program(s) stored in the memory 26. 

[0050] A differential signal of the left front signal FL and the right front signal FR is calculated in a subtract processing 
70. The differential signal is filtered by a 90° direction localization processing 80 acting as a filtering means. As a result 
of filtering, an S component is figured out. In order to compensate a delay of the filtered signal caused by the 90° 
direction localization processing 80, delay processings 78L, 78R are carried out respectively to the left front signal FL 

20 and the right front signal FR. On completion of the delay processings, an M component (a monophonic component in 
center) is generated as a result of adding both the left front signal FL and the right front signal FR carried out in an add 
processing 72. 

[0051] The M component thus generated and the S component are added in an add processing 74 so as to obtain 
the signal L 0UT for the left speaker 4L. Further, the S component is subtracted from the M component in a subtract 

25 processing 76 so as to obtain the signal R OUT for the right speaker 4R. A sound image reproduced by the M signal is 
localized at a position XM between the speaker 4L and the speaker 4R, and the sound image reproduced by the S 
and -S components are respectively localized at positions XL and XR, each positioned at the left and the right side of 
the listener 2. In this way, stereophonic reproduction with surround effect using the M-S method can be realized by 
just utilizing two speakers 4L, 4R. 

30 [0052] Further, the reason for feasibility of the processings described above by using only one 90° direction locali- 
zation processing 80 (the filtering means) is as the following. 

[0053] Assuming equations h a =h LL =h RR , h b =h LR =h RL are satisfied, and the transfer functions H MS of the 90° direction 
localization processing 80 is defined as the fallowings in Fig. 6: 



35 




40 



[0054] And the signals M, S are defined to the left front signal FL and the right front signal FR by: 



45 




50 



[0055] The equation shown below may be satisfied to carry out the localization in the M-S method. 



55 
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[0056] Wherein [H MS ] can be figured out by calculating the equation shown below when a result of h a 2 -h b 2 is not zero. 




ha 



hb 




-1 



hss— hsL 



5 



hb 



ha 



hit — (hss— hsL>, 



[0057] Solving the above equation, the solution is yielded: 



^ M ha+hb 




15 [0058] Wherein h M , h a and h b are considered to be equal when the speakers 4L, 4R are arranged in a short distance, 
so that H M can be defined as 1/2. In this way, the processings described above can be realized by using only one 90° 
direction localization processing 80 (the filtering means) having a transfer function of H s . 

[0059] As described above, the stereophonic reproduction using the M-S method can be realized using just one 
filtering means with two speakers 4L 4R according to this embodiment. In this way, simplification of the circuit can be 
20 achieved when the filtering means is composed of a hardware and simplification of the processings can be achieved 
when the filtering means is composed of the DSP. 

[0060] Further, both the front left signal FL and the front right signal FR carried out the delay processings 78L, 78R 
are added to the output signals Lo UT , R 0UT respectively with a predetermined coefficient k3 as shown in Fig. 7. Thus, 
a sense of the frontal width can be varied by adjusting value of the coefficient k3. 
25 [0061] Although, the processings shown in Fig. 7 are carried out with the DSP 22 in the embodiment described 
above, these processings can be carried out with hardware circuit(s) as well. 

[0062] Another embodiment of the apparatus will be described. The hardware structure of the apparatus is similar 
to that shown in Fig. 3. Fig. 8 is a signal-flow diagram illustrating processings carried out by the DSP 22 in accordance 
with the program(s) stored in the memory 26. 

30 [0063] In Fig. 8, the center signal C carrying out coefficient processings 208a, 209b are added to the front left signal 
FL and the front right signal FR (add processings 44, 46). Predetermined coefficients in a range of 0 to 1 is multiplied 
to the signal in the coefficient processings 208a, 209b (hereinafter, the same procedure shall be applied). 
[0064] The outputs from the add processings 44 and 46 are supplied to the delay means 14L and 14R. In order to 
compensate a delay of both the surround signals SLand SR caused by the 90° direction localization processing, delay 

35 processings are carried out with the delay means 14L and 14R. The delay processings can easily be realized by storing 
a data into the memory 26 with the DSP 22 or internal memory of the DSP 22, then reading out the data after the 
passage of a delay time. 

[0065] The outputs of both the delay means 1 4L and 1 4R are supplied to add processings 50, 52 as a second output 
element after carrying out coefficient processings 205a, 205b in which a coefficient k5 is respectively multiplied to the 

40 outputs. Another coefficient k6 is respectively multiplied to the outputs of the delay means 14L and 14R in coefficient 
processings 206a, 206b, and the outputs are supplied to the add processings 50, 52 as a third output element. 
[0066] Both the front left signal FL and the front right signal FR are added in an add processing 42 after completing 
coefficient processings 202a, 202b in which coefficients k2 : -k2 are respectively multiplied to the signals FL, FR. Phase 
of the signal is inverted when a coefficient having the sign of negative is multiplied to the signal. It is therefore, a 

45 differential signal of the left front signal FL and the right front signal FR is eventually calculated in the add processing 42. 
[0067] Both the surround left signal SL and the surround right signal SR are added in an add processing 34 after 
completing coefficient processings 204a, 204b in which coefficients k4, -k4 are respectively multiplied to the surround 
signals SL, SR. Both the outputs of the add processing 34 and that of the add processing 42 are added in an add 
processing 38, and the resulting outputs are supplied to a 90° direction localization processing 12 DIF. 

so [0068] Both the front signals FL FR are added in an add processing 40 after completing coefficient processings 
201a, 201b in which another coefficient k1 is respectively multiplied to signals FL, FR. 

[0069] Further, both the surround signals SL, SR are added in an add processing 32 after completing coefficient 
processings 203a, 203b in which another coefficient k3 is respectively multiplied to the surround signals SL, SR. Both 
the outputs of the add processing 32 and that of the add processing 40 are added in an add processing 36, and the 
55 resulting outputs are supplied to another 90° direction localization processing 12 SUM . 

[0070] Filtering processings having respective transfer functions H SUM , H D | F as defined below are carried out with 
both the 90° direction localization processing 12 SUM and the 90° direction localization processing 12 D | F . The sound 
image reproduced by both the virtual speaker XL, XR can be localized to the positions located sidewardly in 90 degrees 
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with respect to the central axis 8 of the listener 2. The transfer functions H SUM , H D | F are defined as the followings. 

H SUM=( h a ' +h b'V(H a -* b ) 



H DIF=( h a'- h b') / ( h a- h b) 

wherein the equations h a =h LL =h RR , h b =h LR =h RL , h a .=h L . L =h R . R , h b i=h LR =h R . L are satisfied. 

10 [0071] Another coefficient k7 is multiplied to the output of the 90° direction localization processing 12 SUM in a 
coefficient processing 207a, and the resulting output is supplied to both the add processings 50, 52 as a first output 
element. Further, the coefficient k7 and another coefficient -k7 are respectively multiplied to the outputs of the 90° 
direction localization processing 1 2 D!F in coefficient processings 207b, 207c, and the resulting outputs are respectively 
supplied to the add processings 50, 52 as the first output element. 

is [0072] The low frequency signal LFE is supplied to both the add processings 50, 52 after completing an add process- 
ing 209a in which another coefficient k9 is multiplied to the signal LFE, after carrying out the delay processing 30. 
[0073] The outputs of the add processings 50, 52 are supplied to the high-pass filter processings 56, 58 after com- 
pleting coefficient processings 211a, 211b in which another coefficient k11 is respectively multiplied to the outputs. 
Operation of the high-pass filter processings 56, 58 can be selected either of ON state or OFF state (that is, operated 

20 as a high-pass filter, or pass through the signals). 

[0074] The outputs of the high-pass filter processings 56, 58 are output to output terminals as the left speaker signal 
L 0UT and the right speaker signal R 0UT . 

[0075] Meanwhile, the outputs of the add processings 50, 52 are added with each other in the add processing 54 
after completing coefficient processings 212a, 212b in which another coefficient k12 is respectively multiplied to the 
25 outputs. The output of the add processing 54 is supplied to the low-pass filter processing 60. 

[0076] The output of the low-pass filter processing 60 is added to a signal which multiplying a coefficient k10 to the 
output of the delay processing 30 (a coefficient processing 210a) in the add processing 62. The output of the add 
processing 62 is output to an output terminal as the woofer signal SUB 0UT . 

[0077] A desired sound reproduction method/surround-effect can be selected easily from various sound reproduction 
30 methods and surround-effects by adjusting values of the coefficients while using only one apparatus, according to an 
embodiment shown in Fig. 8. 

[0078] The values of the coefficients k1 through k12 shown in Fig. 8, and the sound reproduction methods/sound 
image localization realized by adjusting these coefficients will be described hereunder. 

[0079] In the case of realizing a two channel stereophonic reproduction system using two speakers 4L, 4R (the 
35 woofer speaker 4S may also used as necessary) is described. In this case, the signals input to the system are both 

the front left signal FL and the front right signal FR. An ordinary two channel system is realized when values of the 

coefficients k1, k2, k3, k4, k6, k7, k8, k9 and k10 are set at values substantially zero as well as setting values of both 

the coefficients k5 and k11 at values substantially not zero. In this case, the sound image can be localized to the 

positions 4L 4R shown in Fig. 4. 
40 [0080] Also, the sound image can be localized to the positions of the virtual speakers XL, XR shown in Fig. 9 when 

the values of the coefficients k3, k4, k5, k6, k8, k9 and k10 are set at values substantially zero as well as setting the 

values of the coefficients k1, k2, k7 and k11 at values substantially not zero. 

[0081] Further, the sound image can be localized to the positions of the virtual speakers XXL, XXR shown in Fig. 4 
when the values of the coefficients k3, k4, k6, k8, k9and k10 are set at values substantially zero as well as setting the 
45 values of the coefficients k1, k2, k5, k7andk11 at values substantially not zero. In this case, the position of the sound 
image can be shifted by adjusting the value of the coefficient k5. 

[0082] Another stereophonic reproduction using the M-S method shown in Fig. 6 is realized when the values of the 
coefficients k1, k3, k4, k5, kB, k9 and k10 are set at values substantially zero as well as setting the values of the 
coefficients k2, k6, k7 and k11 at values substantially not zero. 
50 [0083] Further, still another stereophonic reproduction system in the M-S method shown in Figs. 6 and 7 can be 
realized when the values of the coefficients k1 , k3, k4, k8, k9 and k10 are set at values substantially zero as well as 
setting the values of the coefficients k2, k5, k6, k7 and k11 at values substantially not zero. In the system, the sound 
image can be localized to the positions where the speakers 4L, 4R being arranged. 

[0084] In any of the above cases, the value of the coefficient k1 2 should not be set at a value substantially zero when 
55 the woofer speaker 4S is used. 

[0085] Next, the case of realizing reproduction of a 4 ch. surround sound system using two speakers 4L, 4R (the 
woofer speaker 4S is used as necessary) is described. The signals input to the system are the front left signal FL, the 
front right signal FR and the surround left signal SL and the surround right signal SR. 
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[0086] A surround sound reproduction method in which the front left signal FL is localized to the speaker 4L, the 
front right signal FR is localized to the speaker 4R, the surround left signal SL is localized to the virtual speaker XL 
and the surround right signal SR is localized to the virtual speaker XR, can be realized when the values of the coefficients 
k1 , k2, k6, k8, k9 and k10 are set at values substantially zero as well as setting the values of the coefficients k3, k4, 

s k5, k7 and k11 at values substantially not zero. 

[0087] Another 4 ch. surround sound system shown in Figs. 1 , 2 can be realized when the values of the coefficients 
k6, k8, k9 and k10are set at values substantially zero as well as setting the values of the coefficients k1, k2, k3, k4, 
k5, k7 and k11 at values substantially not zero. In this case, the localized positions XXL and XXR of the sound image 
reproduced by both the front left signal FL and the front right signal FR can be shifted by adjusting values of both the 

10 coefficients k2, k5. 

[0088] In any of the above cases, the value of the coefficient k1 2 should not be set at a value substantially zero when 
the woofer speaker 4S is used. 

[0089] Next, the case of using both the center signal C and the low frequency signal LFE in addition to the above- 
described 4 ch. surround sound systems will be described. 

15 [0090] A 5.1 ch. surround sound system in which a sound image reproduced by input signals is respectively localized 
to the positions of the speakers 4R, 4L and 4S as well as that of the virtual speakers XC, XL and XR shown in Fig. 4 
can be realized when the values of the coefficients k1 , k2, k6, k9 and k12 are set at values substantially zero as well 
as setting the values of the coefficients k3, k4, k5, k7, k8, k10 and k11 at values substantially not zero. 
[0091] Another 5. 1 ch. surround sound system in which a sound image reproduced by the input signals is respectively 

20 localized to the positions of speaker 4S as well as that of the virtual speakers XC, XXL, XXR, XL and XR shown in Fig. 
4 can be realized when the values of the coefficients k6, k9 and k12 are set at values substantially zero as well as 
setting the values of the coefficients k1, k2, k3, k4, k5, k7, k8, k10 and k11 at values substantially not zero. 
[0092] A 5.0 ch. surround sound system without woofer speaker 4S in which a sound image reproduced by input 
signals is respectively localized to the positions of the speakers 4L, 4R and that of the virtual speakers XC, XL and XR 

25 shown in Fig. 4 can be realized when the values of the coefficients k1, k2, k6, k10and k1 2 are set at values substantially 
zero as well as setting the values of the coefficients k3, k4, k5, k7, k8, k9 and k11 at values substantially not zero. 
[0093] Although, localization of the sideward localization means 12 is directed in 90 degrees with respect to the 
central axis 8 of the listener 2 in the embodiments described above, the localization can be other degrees as long as 
the localized positions are located sideward of the listener. Also, a plurality of filters (so called shuffler type filters) are 

30 used for the sideward localization means 12, other type of filters (so called lattice type filters) can be used as well. 
Although, the structure of the system becomes complex when the lattice type filters are used, the use of the lattice 
type filters eliminates a restriction of the symmetrical arrangement of the speakers with respect to the central axis 8. 
[0094] Although, the coefficients k2, -k2 are used for respectively carrying out the coefficient processings 202a and 
202b, the coefficients -k2, k2 can be used for respectively carrying out the coefficient processings 202a and 202b. In 

35 that case, it is necessary to inverse the sign of the coefficient k4 as well as interchanging the 90° direction localization 
processing 12 SUM with the 90° direction localization processing 12 D!F , in addition, it is necessary to invert the signs 
of relevant coefficient processings carried out later on. 

[0095] Although, the DSP 22 is used in the above embodiments, the processings shown in Fig. 5 can be carried out 
with hardware circuit(s). 

40 [0096] While the invention has been described in its preferred embodiments, it is to be understood that the words 
which have been used are words of description rather than limitation and that changes within the purview of the ap- 
pended claims can be made without departing from the true scope and spirit of the invention in its broader aspects. 



1. An apparatus for localizing a sound image reproduced with a pair of speakers arranged at positions left and right 
front of a listener so as to make the listener feel like surrounded by the sound image, the sound image being 
reproduced in accordance with at least a left front signal, a right front signal and a surround signal, each of the 
so signals being input to the apparatus, the apparatus comprising: 

a side localization means, that receives the surround signal, for outputting a signal for localizing the sound 
image of the surround signal at positions sideward of the listener to the left speaker and the right speaker, and 
a delay means, that receives the left front and right front signals, for carrying out a delay processing for equal- 
55 izing a delay time of the left front and the right front signals with a delay time caused by the side localization 

means, and for outputting the left front and the right front signals being delayed respectively to the left speaker 
and the right speaker, 

wherein both the left front and right front signals are further supplied to the side localization means, so as to 
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localize sound image between the left speaker and the left side of the listener and sound image between the 
right speaker and the right side of the listener. 

The apparatus in accordance with claim 1 , wherein positions of the sound images reproduced by the left front and 
the right front signals are shifted respectively by varying a ratio between front signals supplied to the delay means 
and the front signals supplied to the side localization means. 

The apparatus in accordance with claim 1 , wherein the surround signal includes a surround left signal and a sur- 
round right signal. 

The apparatus in accordance with claim 1 , wherein a center signal is added to each of the left front signal and the 
right front signal, and wherein both the left front and the right front signal to which the center signal has been added 
are supplied to the delay means. 

A method for localizing a sound image reproduced with a pair of speakers arranged at positions left and right front 
of a listener so as to make the listener feel like surrounded by the sound image, the sound image being reproduced 
in accordance with at least a left front signal, a right front signal and a surround signal, the method comprising the 
steps of: 

outputting a signal to the left speaker and the right speaker respectively, the signal being generated by carrying 
out localization processing for localizing the sound images of the surround, the left front and the right front 
signals at positions sideward of the listener, and 

delay processing for equalizing a delay time of the left front and right front signals with a delay time caused 
by the side localization, and outputting the delayed left front and right front signals respectively to the left 
speaker and the right speaker. 

An apparatus for localizing a sound image reproduced with a pair of speakers arranged at positions left and right 
front of a listener so as to make the listener feel like surrounded by the sound image, the sound image being 
reproduced in accordance with at least a left front signal and a right front signal, each of the signals being input 
to the apparatus, the apparatus comprising: 

a differential signal generating means for generating a differential signal between the left front signal and the 
right front signal, 

a filtering means for outputting an output generated by filtering the differential signal inputted from the differ- 
ential signal generating means in accordance with a transfer function H s , 

a first delay means for providing a delay equivalent to a delay time caused by the filtering means to the right 
front signal, 

a second delay means for providing the delay equivalent to the delay time caused by the filtering means to 
the left front signal, 

a center monophonic signal generating means for generating a center monophonic signal by adding an output 
of the first delay means and that of the second delay means, 

an add result output means for outputting a signal to be provided to one of the left speaker and the right 
speaker, the signal being generated by adding the output of the filtering means to the center monophonic 
signal, and 

a subtract result output means for generating a signal to be provided to one of the left speaker and the right 
speaker, the signal being generated by subtracting the output of the filtering means from the center monophonic 
signal, 

wherein the transfer function is defined as an equation of H s =(h ss -h SL )/(h a -h b ), and wherein h ss is equal to 
a transfer function from a speaker virtually localized at the right side to the right ear of the listener and a transfer 
function from a speaker virtually localized at the left side to the left ear of the listener, and wherein h SL is equal 
to a transfer function from a speaker virtually localized at the left side to the right ear of the listener and a 
transfer function from a speaker virtually localized at the right side to the left ear of the listener, and wherein 
ha is equal to a transfer function from the right speaker to the right ear of the listener and a transfer function 
from the left speaker to the left ear of the listener, and wherein h b is equal to a transfer function from the left 
speaker to the right ear of the listener and a transfer function from the right speaker to the left ear of the listener. 

The apparatus in accordance with claim 6, 
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wherein the output of the first delay means is provided to the add result output means, and wherein an output 
signal of the add result output means is calculated by adding the output of the first delay means, the center 
monophonic signal and the output of the filtering means, 

and wherein the output of the second delay means is provided to the subtract result output means, and wherein 
an output signal of the subtract result output means is calculated by adding the output of the second delay 
means to a result of subtracting the output of the filtering means from the center monophonic signal. 

The apparatus in accordance with claim 7, wherein a width of a frontal sound field is shifted by varying a ratio 
between the center monophonic signal, and one of the output signal of the first delay means supplied to the add 
result output means and the output signal of the second delay means supplied to the subtract result output means. 

A method for localizing a sound image reproduced with a pair of speakers arranged at positions left and right front 
sides of a listener so as to make the listener feel like surrounded by the sound image, the sound image being 
reproduced in accordance with at least a left front signal and a right front signal, the method comprising the steps of: 

generating a differential signal between the left front signal and the right front signal, 

obtaining a side signal generated by filtering the differential signal in accordance with a transfer function H s , 

obtaining a center monophonic signal by adding the left front signal and the right front signal, 

supplying a signal to one of the left speaker and the right speaker, the signal being generated by adding the 

center monophonic signal and the side signal, and 

supplying a signal to one of the left speaker and the right speaker, the signal being generated by subtracting 
the side signal from the center monophonic signal, 

wherein the transfer function is defined as an equation of H s =(h ss -h SL )/(h a -h b ), and wherein h ss is equal to 
a transfer function from a speaker virtually localized at the right side to the right ear of the listener and a transfer 
function from a speaker virtually localized at the left side to the left ear of the listener and wherein h SL is equal 
to a transfer function from a speaker virtually localized at the left side to the right ear of the listener and a 
transfer function from a speaker virtually localized at the right side to the left ear of the listener, and wherein 
h a is equal to a transfer function from the right speaker to the right ear of the listener and a transfer function 
from the left speaker to the left ear of the listener, and wherein hb is equal to a transfer function from the left 
speaker to the right ear of the listener and a transfer function from the right speaker to the left ear of the listener. 

An apparatus for localizing a sound image comprising: 

a left front signal input terminal capable of supplying a left front signal, 

a right front signal input terminal capable of supplying a right front signal, 

a surround left signal input terminal capable of supplying a surround left signal, 

a surround right signal input terminal capable of supplying a surround right signal 

a first adding means for adding each of signals respectively carried out coefficient processings to the signals 
supplied through the left front signal input terminal and the right front signal input terminal, both the coefficient 
processings being carried out by using a first coefficient, 

a second adding means for adding each of signals, one of the signals carried out coefficient processing to the 
signal supplied through the left front signal input terminal, and the other signal carried out a coefficient process- 
ing to the signal supplied through the right front signal input terminal and the resulting signal being inverted 
its phase, both the coefficient processings being carried out by using a second coefficient, 
a third adding means for adding each of signals respectively carried out coefficient processings to the signals 
supplied through the surround left signal input terminal and the surround right signal input terminal, both the 
coefficient processings being carried out by using a third coefficient, 

a fourth adding means for adding each of signals, one of the signals carried out a coefficient processing to 
the signal supplied through the surround left signal input terminal, and the other signal carried out a coefficient 
processing to the signal supplied through the surround right signal input terminal and the resulting signal being 
inverted its phase, both the coefficient processings being carried out by using a fourth coefficient, 
a fifth adding means for adding an output of the first adding means and that of the third adding means, 
a sixth adding means for adding an output of the second adding means and that of the fourth adding means, 
a first filtering means for carrying out a filtering processing with a transfer function substantially equivalent to 
a transfer function H SUM to an output of the fifth output means, 

a second filtering means for carrying out a filtering processing with a transfer function substantially equivalent 
to a transfer function H D | F to an output of the sixth output means, 

a first delay means for carrying out a delay processing to the signal supplied through the left front signal input 
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terminal for compensating a delay time caused by the first and the second filtering means, 

a second delay means for carrying out a delay processing to the signal supplied through the right front signal 

input terminal for compensating the delay time caused by the first and the second filtering means ; 

a seventh adding means for adding each of outputs respectively carried coefficient processings to the outputs 

of the first delay means and the second delay means, both the coefficient processings being carried out by 

using a sixth coefficient, 

an eighth adding means for adding outputs respectively carried out coefficient processings to the outputs of 
the first delay means, that of the first filtering means, that of the second filtering means, and an output of the 
seventh adding means, the coefficient processing to the output of the first delay means being carried out by 
using a fifth coefficient, and the coefficient processings to the outputs of both the first filtering means and the 
second filtering means being carried out by using a seventh coefficient, and 

a ninth adding means for adding outputs, one of the outputs carried out a coefficient processings to the output 
of the second filtering means and the resulting output being inverted its phase, the remaining outputs respec- 
tively carried out coefficient processings to the outputs of the second delay means, that of the first filtering 
means, and an output of the seventh adding means, the coefficient processing to the output of the second 
delay means being carried out by using a fifth coefficient, and the coefficient processing to both the outputs 
of the first filtering means and that of the second filtering means being carried out by using a seventh coefficient, 
wherein an output of the eighth adding means is generated as a signal for a left speaker, and wherein an 
output of the ninth adding means is generated as a signal for a right speaker, 
and wherein both the transfer functions H SUM , H D | F are defined as equations of 

H suM=( h a+ h b | ) / (h a +h b ) 



H D iF=( h a'- h b')/(h a -h b ) 

and wherein equations h a =h LL =h RR , h b =h LR =h RL , h a ,=h LL =h RR , h b .=h L . R =h R . L are satisfied, 
and wherein h RR is a transfer function from the right speaker to the right ear of a listener h RL is a transfer 
function from the right speaker to left ear of the listener, h LL is a transfer function from the left speaker to the 
left ear of the listener, h LR is a transfer function from the left speaker to the right ear of the listener, h R . R is a 
transfer function from a speaker virtually localized at the right side to the right ear of the listener, h R . L is a 
transfer function from the speaker virtually localized at the right side to the left ear of the listener, and h L , L is 
a transfer function from the speaker virtually localized at the left side to left ear of the listener, and h L , R is a 
transfer function from the speaker virtually localized at the left side to the right ear of the listener. 

The apparatus in accordance with claim 1 0, wherein the apparatus further comprises a low frequency signal input 
terminal capable of supplying a low frequency signal, and 

a third delay means for carrying out a delay processing to the signal being input through the low frequency 
signal input terminal for compensating a delay time caused by the first and the second filtering means, 
and wherein an output carried out a coefficient processings using a ninth coefficient to an output of the third 
delay means is supplied to the eighth and ninth adding means, 

and wherein the apparatus further includes a first high-pass filtering means for eliminating low frequency com- 
ponent of an output carried out a coefficient processings using a eleventh coefficient to the output of the eighth 
adding means, 

a second high-pass filtering means for eliminating the low frequency component of an output carried out a 
coefficient processings using the eleventh coefficient to the output of the ninth adding means, 
a tenth adding means for adding each of outputs respectively carried out coefficient processings to the outputs 
of the eighth adding means and the ninth adding means, both the coefficient processings being carried out by 
using a twelfth coefficient, 

a low-pass filtering means for passing only the low frequency components of an output of the tenth adding 
means, and 

an eleventh adding means for adding an output carried out a coefficient processing using a tenth coefficient 
to the output of the third delay means and an output of the low-pass filtering means, 
and wherein an output of the first high-pass filtering means is generated as a signal for the left speaker, and 
wherein an output of the second high -pass filtering means is generated as a signal for the right speaker, and 
wherein an output of the eleventh adding means is generated as a signal for a woofer speaker. 
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The apparatus in accordance with claim 10, wherein the apparatus further comprises 
a center signal input terminal capable of supplying a center signal, 

a twelfth adding means for adding a signal carrying out a coefficient processing using an eighth coefficient to 
the signal supplied through the center signal input terminal and the signal supplied through the left front signal 
input terminal, and 

a thirteenth adding means for adding the signal carried out the coefficient processing using the eighth coeffi- 
cient to the signal supplied through the center signal input terminal and a signal supplied through the right 
front signal input terminal, 

and wherein an output of the twelfth adding means is supplied to the first delay means as an input thereof, 
and wherein an output of the thirteenth adding means is supplied to the second delay means as an input thereof. 

The apparatus in accordance with claim 1 1 , wherein the apparatus further comprises 

a center signal input terminal capable of supplying a center signal, 

a twelfth adding means for adding a signal carrying out a coefficient processing using an eighth coefficient to 
the signal supplied through the center signal input terminal and the signal supplied through the left front signal 
input terminal, and 

a thirteenth adding means for adding the signal carried out the coefficient processing using the eighth coeffi- 
cient to the signal supplied through the center signal input terminal and a signal supplied through the right 
front signal input terminal, 

and wherein an output of the twelfth adding means is supplied to the first delay means as an input thereof, 
and wherein an output of the thirteenth adding means is supplied to the second delay means as an input thereof. 

A method for localizing a sound image comprising the steps of: 

obtaining an add signal and a differential signal of a left front signal and a right front signal by carrying out 
coefficient processings to both the left front and the right front signal when both the left front and right front 
signal being applied, 

defining both the left front and the right front signal as an add front signal and a differential front signal respec- 
tively, 

obtaining an add signal and a differential signal of a surround left signal and a surround right signal by carrying 
out coefficient processings to both the surround left and the surround right signal when both the surround left 
and the surround right signal being applied, 

defining both the surround left and the surround right signal as an add surround signal and a differential sur- 
round signal respectively, 

supplying a signal calculated by adding both the add front signal and the add surround signal to a first filtering 
means forming a shuffler type filter, 

supplying a signal calculated by adding both the differential front signal and the differential surround signal to 
a second filtering means forming the shuffler type filter, 

obtaining both an add signal and a differential signal of signals respectively carried out coefficient processings 
to both an output of the first filtering means and an output of the second filtering means, 
defining both the add signal and the differential signal as a first left output element signal and a first right output 
element signal, 

defining both a signal respectively carried out coefficient processings to both the left front and the right front 
signal and a signal carried out coefficient processings to outputs of each delay means as a second left output 
element signal and a second right output element signal, 

adding outputs carried out coefficient processings to each outputs of the delay means, 
defining the outputs as both a third left output element signal and a third right output element signal, 
defining the first left, the second left and the third left output element signal as left output signals, and 
defining the first right, the second right and the third right output element signal as right output signals. 
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